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Abstract. A two-person zero-sum infinite dimensional differential game of infinite 
duration with discounted payoff involving hybrid controls is studied. The minimizing 
player is allowed to take continuous, switching and impulse controls whereas the maxi- 
mizing player is allowed to take continuous and switching controls. By taking strategies 
in the sense of EUiott-Kalton, we prove the existence of value and characterize it as the 
unique viscosity solution of the associated system of quasi-variational inequalities. 
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1. Introduction and preliminaries 

The study of differential games with EUiott-Kalton strategies in the viscosity solution 
framework is initiated by Evans and Souganidis [3] where both players are allowed to 
take continuous controls. Differential games where both players use switching controls 
are studied by Yong [6, 7]. In [8], differential games involving impulse controls are con- 
sidered; one player is using continuous controls whereas the other uses impulse control. 
In the final section of [8], the author mentions that by using the ideas and techniques of 
the previous sections one can study differential games where one player uses continu- 
ous, switching and impulse controls and the other player uses continuous and switching 
controls. The uniqueness result for the associated system of quasi-variational inequalities 
(SQVI) with bilateral constraints is said to hold under suitable non-zero loop switching- 
cost condition and cheaper switching condition. In all the above references, the state space 
is a finite-dimensional Euclidean space. 

The infinite dimensional analogue of [3] is studied by Kocan et al [4], where the authors 
prove the existence of value and characterize the value function as the unique viscosity 
solution (in the sense of [2]) of the associated Hamilton-Jacobi-Isaacs equation. 

In this paper, we study a two-person zero-sum differential game in a Hilbert space 
where the minimizer (player 2) uses three types of controls: continuous, switching and 
impulse. The maximizer (player 1) uses continuous and switching controls. We first prove 
dynamic programming principle (DPP) for this problem. Using DPP, we prove that the 
lower and upper value functions are 'approximate solutions' of the associated SQVI in the 
viscosity sense [2]. Finally we establish the existence of the value by proving a unique- 
ness theorem for SQVI. We obtain our results without any assumption like non-zero loop 
switching-cost condition and/or cheaper switching-cost condition on the cost functions. 
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This will be further explained in the concluding section. Thus this paper not only gener- 
alises the results of [8] to the infinite dimensional state space, it obtains the main result 
under fairly general conditions as well. 

The rest of the paper is organized as follows. We set up necessary notations and assump- 
tions in the remaining part of this section. The statement of the main result is also given 
at the end of this introductory section. The DPP is proved in §2. In this section we also 
show that the lower/upper value function is an 'approximate viscosity solution' of SQVI. 
Section 3 is devoted to the proof of the main uniqueness result for SQVI and the existence 
of value. We conclude the paper in §4 with a few remarks. 

We first describe the notations and basic assumptions. The state space is a separable 
Hilbert space E. The continuous control set for player ;, ; = 1,2, is U', a compact metric 
space. The set D' = {d\,. . . ,d'^.}; i= 1,2; is the switching control set for player The 
impulse control set for the player 2 is A", a closed and convex subset of the state space E. 
The space of all f/'-valued measurable maps on [0,oo) is the continuous control space for 
player ; and is denoted by "^'i 

= {m'; [0,°o) U'\u' measurable}. 

By ^'[0,t] we mean the space of aU {/'-valued measurable maps on [0,/] that is, 

'^%t] = {u': [0,t] U'\u' measurable}. 

The switching control space 3' for player i and the impulse control space J(f for player 
2 are defined as follows: 

= l^'(-) = LdUXl0^_„e-)(-) ■d)€D\ (ej) c [0,oo], 

^ = o,(0;)T-,rf;-i^rf;if0;<-|, 

= 1^ (•) = I ^yZ[r,H (•) : e K, {xj) c [O,-], (t^) T - j . 

An impulse control <^( ) — Y.j>Q^jX[xj,oo]{-)y consists of the impulse times T/s and 
impulse vectors i^/s. We use the notation 

{^)l,j = Tj and (^)2,; = ^y. 

Similarly for switching controls d^{-) and d^{-) we write 

{d\j = dj and id')2,j=d], 

(d^)ij^ef and {d%.j = d]. 

Now we describe the dynamics and cost functions involved in the game. To this end, let 
^1 = ^1 X ^1 and = ^2 X ^2 >^ („i (.)^ (.)) g cgi {u'^{.),d'^{.),E^ (.)) g 

the corresponding state yx{-) is governed by the following controlled semiUnear evo- 
lution equation in E: 

y,{t)+Ay,{t)=f{y,{t),u\t),d\t),u^{t),d'{t)) + m.yx{0-)=x, (1.1) 
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where f:ExU^ xD^ xU^ xD^ —^E and —A is the generator of a contraction semigroup 
{S{ty,t >0}onE. 

(Al) We assume that the function / is bounded, continuous and for a\l x,y gE, d' gD', 
u' G U\ 



WfixM^d^u^d"-) - f{y,u\d\u\d'-)\\ <L||x-_y 



(1.2) 



Note that under the assumption (Al), for each x G E, d'(-) G 2i\ u'{-) G and ^ (•) G 
J(f there is a unique mild solution yx{-)ofil.l). This can be concluded for example, from 
Corollary 2.1 1, chapter 4, page number 109 of [5]. 

Let A;: E X f/' xD^ x f/^ x ^ M be the running cost function, c': D' x D' 
switching cost functions, and i. K the impulse cost function. 



the 



(A2) We assume that the cost functions k,c\l are nonnegative, bounded, continuous, and 

for all x,y G E, d' G D', u' G U\ K, 

\k{x,u^,d^,u^,d^) —k{y,u^,d^,u^,d^)\ < L\\x — y\\, 

/(^o + ^i)</(^o)+/(^i),v^o,^ie^:, 



lim /(^)=~, 



inf c'{d[,d'2) 

4/4 



.c'^>0. 



(1.3) 



Remark 1.1. The subadditivity condition Z(^o + ^\) < K^o) + K^i) is needed to prove 
Lemma 3.1 which, in turn, is required to establish the uniqueness theorems (and hence 
the existence of value for the game) in §3. This condition makes sure that, if an impulse 
1*0 is the best option at a particular state yo, then applying an impulse again is not a good 
option for the new state >'o + ^q. 

Let A > be the discount parameter. The total discounted cost functional Jx'. '^^ x 
^2 ^ M is given by 

Mu\-),d\-),u\-),dH-Ui-)]= r^-^'k{yx{t),u\t),d\t),u\t),d\t))dt 

Jo 



Ee-^^cH^-i,^) 



> ■ (1.4) 



+ £e-Hc2(4_^,4) + £e-^^^/(^,) 
;>o ;>i 

We next define the strategies for player 1 and player 2 in the EUiott-Kalton framework. 

The strategy set T for player 1 is the collection of all nonanticipating maps a from to 
'to^. The strategy set A for player 2 is the collection of all nonanticipating maps /3 from 

^1 to 

For a Strategy j3 of player 2 if j3 (m^ (.)) = {u^{-),d^{-),B,{-)), then we write 
Yl,^{u\-)4\-)) = u\-),Il2fi{u\-)4\-))=d\-) and 11,^ {u\-), d\-)) = £,{■)■ 

That is, n, is the projection on the ;th component of the map j3 . Similar notations are used 

for a{u'^{-),d'^{-),t,{-)) as well. Hence, 

n,a{u\-),d\-),^{-)) = u\-) and n2a{u\-),d\-)M-)) =d\-). 
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Let S>^'^' denote the set of all switching controls for player ; starting at d\ Then we 
define sets 

^hd' ^a^i ^^i,d' and "^2,^" = X X ^. 

Let A''^ denote the collection of all J3 e A such that IlijS (0) = and P*' be the collection 
of all a e r such that 112 a (0) = 

Now using these strategies we define upper and lower value functions associated with 
the game. Consider Jx as defined in (1.4). Let Jx ' be the restriction of the cost func- 
tional Jx to '^i-'' X _ The upper and lower value functions are defined respectively 
as follows: 

Vi'-''\x) = sup mf jf-^^\a{uH-),dH-)m).u\-)^d\-),^{% (1.5) 
V':'''\x)= mf ^v.^ jf'''\u\-),d\-),^{u\-),d\-))]. (1.6) 



Lety+ = {y+ {d\d^) xD^} andV. = {yf {d\d^) xD^}. lfV+ = 
V- = V, then we say that the differential game has a value and V is referred to as the value 
function. 

Since all cost functions involved are bounded, value functions are also bounded. In 
view of (Al) and (A2), the proof of uniform continuity of V+ and V- is routine. Hence 
both y+ and V- belong to BUC(E;M'"i^'"2), the space of bounded uniformly continuous 
functions from E to ^""2. 

Now we describe the system of quasivariational inequalities (SQVI) satisfied by upper 
and lower value functions and the definition of viscosity solution in the sense of [2]. 

Forx,p e E, let 

H^''^ (x,p) = max min [{—p,f{x,u^ ,d^ ,u^,d^)) —k{x,u^ ,d^ ,u^,d^)], (1.7) 

u^eu^u'eu' 

H+'''\x,p)= min max\{-p,f(x,u\d\u^,d^))-k(x,u\d\u^,d^)] (1.8) 

and for V e C(E; R"! ^'"z ), let 

M'^y\y\{x) = min[y^''^^(x)+c2(J^j2^j^ ^^^^ 
M^l^^^WMx) = max ^'^^ (x) - {d^ ,d^)V (1.10) 

iv[y'^'''^'](x) = inf[y'''''''(x+^)+/(i^)]. (1.11) 



The HJI upper systems of equations associated with y_ of the hybrid differential game 



Infinite dimensional differential games with hybrid controls 



Til 



are as follows: for {d^,d^) G x D^, 

Hf''''(x,DV''''d'), 1 

(HJI1+) 



max{min(Ay'''-''' + {Ax,DV''' + ■''\x,DV''' ^'''), ) 

y</' _ [V] ) , v^' - Ml' [y] , y'' - iv[y<^' ■<^'] } = o J ' 



(Hn2+) 



wheTeHf'^\Mi''^\Mf'''^ md N[V''' •''^] are as given by (1.8), (1.9), (1.10) and (1.11) 
respectively. 

Note here that for any real numbers a,b,c,d, {a\/ b) Ac Ad < {aV cV d) Ab. 

If we replace Hj^ ' in the above system of equations by H_' , then we obtain the HJI 
lower system of equations associated with V+ and is denoted respectively by (HJIl— ) and 
(HJI2-). 

If y satisfies both (HJI1+) and (HJI2+), then we say that V satisfies (HJI+) and simi- 
larly if it satisfies both (HJIl -) and (HJI2-), we say that V satisfies (HJI-) . 

Now let us recall the definition of viscosity solution (in the sense of Crandall and Lions 
[2]). To this end, let 

C\E) = {<l):E^R\<j) continuously differentiable}, 
Lip(E) = {y/-; E — > M | y/- Lipschitz continuous}, 

^ = I o = + e (E), V/ e Lip(E)}, 

Z)+3.W = limsup 1 [^.(y) - 3.(5(5));)], 
D^^ix) = liminf l[a.(^) -0.(5(5)^)], 

oJ-Oj— »^ O 

(fi d^ d^ d^ d^ 

H+T {x,p)= supH_^_' {x,p + q); H_p {x,p)= sup i/_ ' {x,p + qy, 
Hff{x,p) = inf Hf-'''\x,p + q); H^\f{x,p) = inf H'^^^''^ {x,p + q). 

\\l\\<r - M\<r 

DEFINITION 1.2. 

A continuous function y is a viscosity subsolution of (HJI1-I-) if 

min{max(Ay^''^'(x) +D-^^{x) +Hf'^{x,D<{>{x)),V''''''\x) -m'^'\v]{x), 
V''''''\x)-N[V''''''']{x)),V''''''\x) -Mi'^^Mix)} < 0, 

for any <I> G ^, {d\d^) xD^ and local maximum 
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A continuous function V is a viscosity supersolution of (HJI1+) if 

min {max {XV^' '''^ (i) + D+<i>{x) + H'''^{x, (i) ) , y^' (x) - m1' '''' [V ] (x) , 

yrf',rf^(je) _Ar[y'^'.'^'](x)),y'''''''(x) -m^ ''^'[y](x)} > o, 

forany<I>G =5^, {d^,d^) gD' x and local minimum x of V'*''^ - <&. 

If y is both a subsolution and a supersolution of (HJI1+), then we say that y is a 
viscosity solution of (HJ11+). 

DEFINITION 1.3. 

A continuous function V is an approximate viscosity subsolution of (HJI1+) if for all 
R>0, there exists a constant Cr > such that 

min {max (Ay^' (x) + D^<t>{x) + uf '''' (x, D0 (x) - CRL{\i/j), 

V''''''\x) -Ml'''^'[y](Jc),y'''''''(x) -N[V'''^''']{x)),V''''''\x) -Mi'''\v]{x)} 

<o, 

for any $ e ^, ( J\ e X Z)2 and local maximum x e Br (0) of y'' '''^ - 3>. 

A continuous function V is an approximate viscosity supersolution of (HJI1+) if for all 
R>Q, there exists a constant Cr>0 such that 

min{max(Ay''''''^(x) +D-^<^{x) +Hf'''\x,D(l){x)+CRL{\if)), 

Vd\d^{x) -Mi''''\v]{x),V''''''\x) -N[V''''''^]{x)),V''''''\x) - Alf ''^\v]{x)} 

>0, 

for any {d\d^) xD^ and local mmimum x 

If V is both an approximate subsolution and an approximate supersolution of (HJI1+), 
then we say that y is an approximate viscosity solution of (HJI1+). 

In the above definitions, L{\j/) is the Lipschitz constant of and Br[0) is the closed 
ball of radius R around the origin. 

Remark 1 .4. One can easily prove that a viscosity solution is always an approximate vis- 
cosity solution. For more details about the approximate viscosity solution and its connec- 
tions with other notions of solutions, we refer to [2] and [4]. In the infinite dimensional 
set-up it is easier to establish that the value functions are approximate viscosity solutions 
than to prove that they are viscosity solutions. Therefore, as pointed out in [4], the concept 
of approximate viscosity solution is used as a vehicle to prove that the value functions are 
viscosity solutions. 

In the next section, we show that y_ is an approximate viscosity solution of (HJI-I-) and 
V+ is an approximate viscosity solution of (HJI— ). 
We say that the Isaacs min-max condition holds if 

jjd\d^ =fjd\d^ (ci\(f-)^D^ x£)2. (1.12) 
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Under this condition, the equations (HJI1+) and (HJI2+) respectively coincide with 
(HJIl — ) and (HJI2— ). We now state the main result of this paper; the proof will be worked 

out in subsequent sections. 

Theorem 1.5. Assume (Al), (A2) and the Isaacs min-max condition. Then V- = V+ is 
the unique viscosity solution of (Hn+) {or (Hn-)) in BUC (E, ^'"z ). 

Remark 1.6. The Isaacs min-max condition (1.12) holds for the class of problems where 
/ is of the form 

f{x,u^ ,d^ ,u^,d^) = f\{x,u^ ,d^ ,d^) + f2{x,d^ ,u^ ,d^). 



2. Dynamic programming principle 

In this section, we first prove the dynamic programming principle for the differential 
games with hybrid controls. We first state the results. The proofs will be given later. 
Throughout this section we assume (Al) and (A2). 

Lemma 2.1. For {x,d^ ,d^) & Ex x and t > 0, 

\-^'k{y,{s),u\s),d\s), 

^l/3(Ml,^^l)(i),^2J3(M^^;l)(^)) d* 
-£e-^«lc^(4_i,4) 



(jc) = inf sup 



e]<t 



- L e-^(n,/3),,^2((n2/3)2,,._i,(n2^)2j) 

(n2i3)i.;<( 

- I e-^(n3/3),,;^n3^)2,,.) 
(n3i3)ij<» 



+e-^V_^'«'"^'^W(3;.(0) 
Lemma 2.2. For {x,d\d^) eExD^ xD^ andt > 0, 



>■ (2.1) 



V+ ''^ (x) = sup inf 



1 '^2,d^ 



e-^%y,is)Mu\d\^)is)y{s),d'{s),^{s))6s 







- E e-^(n2a)i,,^i((n2a)ij_i,(n2a)l,7) 

(n2a)ij<r 

+ £ e-^«^c2(4_i,4) 
ef<t 
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Lemma 2.3. The following results hold: 

(i) Mf'^'[y_](x)<y^'''''(x). 

(ii) y^'-'^'w <min{Ml''^'[y_](x),^[y_!''^^'](x)}. 

(iii) Let {x,d^, d^) be such that strict inequality holds in (i). Let ^ e Aq . Then there exists 
to > such that the following holds: 

For each <t <to, there exists u^''{-) € [0,f] such that 

V^''''\x)-t^ < [\-^'k{y,{s),u'''{s),d\p{u'''{-),d'){s)) ds 
Jo 

+ e-^>V^''''\y,{t)). 

(iv) Let {x,d^,d^) be such that strict inequality holds in (ii). Let u} G U^. Then there 

exists fo > such that the following holds: 

For each Q<t<tQ, there exists with [u^ ,d^))i^i,(Yl3P* {u" ,d^))\^\ >/o 

such that 

V^'''^\x)+t^ > [\-H{y^{s),u\d\^'{u\d^){s)) As 
Jo 

+ e-^'V^'''''{y,{t)). 

Lemma 2.4. The following results hold. 

(i) Mf^''\v+]ix)<vf''^\x). 

(ii) Vf''\x) < rmn{M'_!''\v+]{x),N[vt''\x)}. 

(iii) Let {x,d^,d^) be such that strict inequality holds in (ii). Let a e Fq . Then there 

exists to > such that the following holds: 

For each Q<t <to, there exists u-^''{-) € ^-^[Qjt] such that 

vi''^\x)+t^ > j\-H{yM,u^'\s),d^,a{u'^'\d^,^'-){s)) As 

+ ^~^'vi''\y.{t)). 

(iv) Let {x,d^ ,d^) be such that strict inequality holds in (i). Let e f/^. Then there exists 

to > such that the following holds: 

For each <t <to, there exists a' S with {Tl2a' {U^ ,d^ > ?o such that 

Vf'''\x)-t^ < J^e-^'k{y,{s),u\d\a'{u\d\rM) ^ 
+ c-''V^'''\y,{t)). 

We prove Lemmas 2. 1 and 2.3. The proofs of Lemmas 2.2 and 2.4 are analogous. 
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Proof of Lemma 2.1. Let {x,d\d^) G E x x and ? > 0. Let us denote the RHS of 
(2.1)byiy(x).Fixe>0. 
Let ^ e A^^ be such that 



W{x) > sup 



[' c-^'k{y,{s),u\s),d\s),UiP{u\d'){s),U2P{u\d%)) ds 
Jo 



-£e-^^/ci(j]_i,j])+ £ e-^(n2^)wc2((n2^)2,,_i,(n2j3H,) 
ej<f (n2^)i,;<f 

(n3^)l,;<! 



e. 



By the definition ofV-, for each (Mi(-),i/H-)) there exists Pui(-),di(-) eA(n2^)W 

such that 

Define 5 e A''^ by 

J3(m1(-),^/H-))W; 



By change of variables, we get 

yx(t) 

e-^^A:fe(T),Mi(T),ji(T),(ni5)(Mi,^/i)(T),(n25)(Mi,ji)(T))dT 
e ic {dj_i,dj) 



+ £ e-^(n25),,^2^n25)2J-l,(n25)2j) 

(n25)ij>f 

+ I e-^(n35),,;((n35)2j). 
(n35)ij>f 

Substituting above in the inequality of ^'^'^'^^^^^'^(>';c(0) and then in the inequality 
for W{x) will imply 

W{x)>jf^'^'[u^{-),d\-),8iu\d^)i-)]-2e. 

This holds for all (m' (•), (•)) e '^i''^' and hence W{x) > V^''''\x) - 2e. Since £ > is 
arbitrary, we get W{x) > (x). 



242 



A J Shaiju and Sheetal Dharmatti 



We now prove the other type of inequaUty. Fix j3 e A''^ and e > 0. Choose 
(Mi(-),ir^(-)) e^i'''' such that 

W(x) < f e-^'k{y^{s),u\s),d\s),l5{u\d^){s))ds 
Jo 

- £ e-^^ci(j]_i,j]) 



dj<t 



+ ^ e-^(n,^)i.c2((n2/3)2j-i,(n2/3)2j) 

+ I e-^(n3/3)i,;^n3j3)2j) 
(n3/3)ij<« 



(2.2) 



Now for each u^{-), define it' (•) by 



u^{s — t); s>t 



Similarly, for each c/' (•), we define d^{-). Let 

P{u\.U\.)){s)=l5{u\-),d~'ms + t). 
By the definition of V-, we can choose («!(•), i/H-)) G ^'''^ such that 



<J 



rfiW,(n2/3)(<)r.,i 



[Mn- + f),^'(-+0>i3(M\^^')(- + 0] + ee^'- 



(2.3) 



Now, combining (2.2) and (2.3), we get 
W{x) < 



f c-^%y,{s),a\s),d-'{s),P{a\d-'){s)) 6s- £ e 

+ £ e-^n^ft.^c2((n2i3)2j-i,(n2^)2j) 

(n2j3)i,;<« 
+ I e-^(n3^)'^/((n3/3)2j) 



e-^«/ci(4_i,4) 



By change of variables, it follows that 

w{x)<jf-'''[u\-),d~'(-),l5{a\d'){-)]+2e. 

This holds for any /3 G A''^ and hence 

<y^'^'''(x) + 2e. 
The proof is now complete, since e is arbitrary. 



Infinite dimensional differential games with hybrid controls 243 

Proof of Lemma 2.3. We first prove (i) and (ii). By the definition of V~, for any ^ d^, 

V^''''\x) < V^'''^^{x) +c^{d^,d^). 
From this we get 

V^''''\x)<Mi''''\V-]{x). 
The inequahty 

V^'''^\x)>Mi'''\v.]{x) 

can be proved in a similar fashion. 
Clearly for any ^ GK and j3 G A'' , 

y^''''(x) < supjf_;f[u\-),d\-),l5{u\d'){-)]+l{a 

Taidng infimum over /3 e A'^^ and then over ^ e ^, we obtain 

V^''''\x)<N[V^''''']{x). 

We now turn to the proof of (iii). By Lemma 2.1, for each t > 0, there exists 
(mI'^(-), e^i'''' such that 

V^'''^\x)-t^ < [' e-^'k(yAs)y''(s),d^''(s),^(u^'',d^'')(s))ds 
Jo 

- £ e-^'''''c'(d]^,d]0+e-^'y_^'''W'("^^)«(^.(0). 
ey<r 

It is enough to show that, for some to > 0, 0^ ' > f for all < / < Jq. If this does not 
happen, then there would exist a sequence f „ J, such that 6^''" < t„ for all n. This would 
imply that 

V^'''\x)-{dl''"f < /' c-^%y,is),u'''"{s),d'''"{s),^{u'''",d''''')is))ds 

JO 

-e-^«.""ci(rf\rf;''")+e-^«J'V_'''"'''(>,-(0/''«)). 

We may assume that for all n, dl''" = d^ ^ d^ . Now by letting n ^ oo in the above 
inequahty, we get 

Vi'^''\x) < -c\d\d~')+vf'''\x) 
< Mi^'^V-Kx). 

This contradicts the hypothesis that strict inequahty holds in (i) and the proof of (iii) is 
now complete. 
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We next prove (iv). By Leiimia 2.1, for each f > 0, there exists /3' S A*^ such that 
Jo 

(n2j3')ij<f 

+ £ e-^^)/(^j). 
(n3j3')ij<r 

It is enough to show that, for some ?o > 0, min(0j^'', t{) > ? for all < ? < to. If this 
were not true, then (without any loss of generality) there would be a sequence f„ | and 
two cases to consider. In the first case, B^''" < min(f„,Tj") whereas in the second case 
Tj" < min(f„, By dropping to a subsequence if necessary and proceeding as in the 

proof of (iii), we get ' {x) > Mi' '''^ [V-] (x) in case 1 and ' '''' (x) > N[V^' '''^] {x) in 
case 2 respectively. This contradicts our hypothesis that strict inequality holds in (ii) and 
the proof is complete. 

Remark 2.5. From the proofs it is clear that, instead of the term t-^ in the statement of 
Lemma 2.3 and Lemma 2.4, we can take any modulus p{t). 

We now state the following result (Corollary 4.9, [4]) which is useful in proving that 
V- (resp. V+) is a viscosity solution of (HJI+) (resp. (HJI— )). 

Lemma 2.6. Let <P e .5^, x eE and D^<$>{x) < o°. Ifv{-) G L^{[0,T];E) andy{-) solves 

y{t)+Ay{t)=v{t)\ 0<t<T, 
yiO)=x, 
then ast ^0, 

e-^'<i>{y{t))-<P{x) < ^^^D^0{x)+L{xi/) [' c-^'\\v{s)\\6s 

A Jo 

+ f^-'^m{y{s)),v{^))-X<f{y{s))] ds+o{t), 
Jo 

uniformly for all v(-) uniformly integrable on {0,T). 

We are now ready to prove that V- (resp. V+) is an approximate viscosity solution of 
(HJI+) (resp. (HJI-)). 

Theorem 2.7. The lower value function V- is an approximate viscosity solution of 
(HJ1+) and the upper value function V+ is an approximate viscosity solution o/(HJl— ). 

Proof. We prove that V- is an approximate viscosity solution of (HJI+). The other part 
can be proved in an analogous manner. 

Let Cr be such that \\f{y^(t),u\t),d'^{t),u^{t),d^{t),E,{t))\\ < C/; for all < ? < 1, 
<R, {u\-),d\-)) G and {u^{-),d^{-),^{-)) e"^^. 
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We first prove that V- is an approximate subsolution of (HJI1+). Let {x,d^,d^) e E x 
X and^ = <j) + Y € ^ he such that has a local maximum at f e B«(0). 



Without any loss of generality, we may assume that (x) = <^{x). Jf V" (x) = 

Mf-''^[V-]{x), then we are done. Assume that V^''''^{x) > Mf''^^[V-]{x). It suffices to 
show that 

AO(x) +D2^{x) +Hf'''\x,D(l){x))-CRL{\if) =: r < 0. 

If possible, let r > 0. This implies that for every e U^, there exists = m^(m^) such 
that 

X0{x)+D2^{x)-{D<j){x),f{x,u\d\u^,d^)) 
-k{x,u^,d^,u^,d^)-CRL{\j/) > ^. 

By Proposition 3.2 of [4], fort small enough, there exists /3' E Ajff such that 
X^{x)+DX^{x)-{D<l>{x),f{x,u\s),d\l5'{u\-),d'){s))) 
-k{xy{s),d\l5'{u\-),d'){s))-CRL{xif) > 

forallM'(-) e'^^[0,f]and a.e.sG [0,t]. 
This yields 

A«>(yi(.))+D^4>(i)-(Z)(/)fe(.)),/fe(.),«'(.),«!i,j3'(«n-),«f')(*))) 
-k{y,{s),u\s),d\l5'{u\-),d'M)-CRL{xi/) > 

for a.e. s G [0,?] and t small enough. 

Multiplying throughout by e"^'' and integrating from i = to 5 = we get 



Z)^0(x)-C«L(v/)-- 



ds 



>• (2.4) 



- re-H(y,W,«'W,^S/3'(«'(-),^')W)' 
./o 

+ re-^^[A<I>(3;^(*)) 

-{D<^{y,{s))J{yi{s),u\s),d\^'{u\-),d'){s)))]As>Q J 
By Lemma 2.3(iii), for t small enough, there exists S [0,?] such that 

yf'''''(x)-o(o < re-Hfe(*),Mi''(*),^/Sj3'(Mi''(-),^;i)W) d5 

^0 

+ e-^'y^'''''(y,(0). (2.5) 
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We now claim that Z)J<5(x) < <». We may take <I> to be Lipschitz. 

mx)-^{y,{5))\\<\\m~^-^'^{ym)\\+{^-^'-m^iym)\\ 

<o(5)+Q5 + Q(e-^5-l). 

Therefore 

mx)-^{s{d)x)\\ < wm-'^iyAm+mcxS 

<o{8)+C5 + C{&-^^ -\). 

This proves the claim that D^^>(x) < 0° and hence from Lemma 2.6, it follows that as 
t^Q, 

+L{yif) ['^-^^\f{y,{s)y^'{s),d\p'{u'^'{-),d'){sm ds 
Jo ^ 

+ f c-''m{y,{s)),f{y,{s)y^'{s),d\ 
Jo 

l5'{u'''{-U'){s)))-X^{y,{s))]ds + o{t). 

(2.6) 

Combining (2.4), (2.5) and (2.6), we obtain 

^>e-^'a.(j,(0)-3.(x) 

+ fc-^'k(y,{s)y''{s),d\p'{u'''{-),d'){s)) ds+o{t) 
Jo 

>o{t). 

This contradiction proves that V- is an approximate subsolution of (HJ11+). 

To prove that V- is an approximate supersolution of (HJ11+), let x 6 Br{Q) be a local 

minimum of y_ ' — <J>. Without any loss of generality, we may assume that VL ' {x) = 

3>(x). If ' '^^ (Jc) = m1' '''' [V-] (Jc) or ' •''^ (x) = N[V^' '^^] (f ), then we are done. Assume 

that yf ' '''^ (Jc) < min(Ml' [V-] {x),N[V^' (Jc)). In this case, we need to show that 

A«I>(x) +D^^{x)+H'1''''^{x,D(I){x))+CrL{\i/) =: f > 0. 
If possible, let r < 0. Then 

X0{x)+D^0{x)-{D<j){x),f{x,u\d\u^,d^)) 

-k{{x,u^,d^,u'^,d'^)+CRL{Y) < ^, 
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for some G and all G U^. This implies that, for all j3 e Aq^ and s small enough 

k^{y,{s))+D+^{x)-{D<l>{y{s)),f{yx{s),u\d\P{u\d'){s))) 
-k{yji{s),a\d\l3iu\d'){s))+CRLiY) < ^. 

Multiplying throughout by e^'^* and integrating from to t, we get 



Z)+«>(x)+C«L(v/)-- 



-A 



Jo 

- [\-^'k{yi{s),u\d\^{u\d^){s)) ds < 

^0 



Now by Lemma 2.3(iv), for t small enough, there exists ^' G Aq^ such that 

V^'''^\x)+o{t) 



(2.7) 



> 



f ^-^'k{y,{s),u\d\^\u\d'){s)) ds + ^-^'V^'^^'iy^it)). (2.8) 
Jo 



Now proceeding as in the first part of the theorem, we can show that Z)^«I>(x) > — 1». 
Using Lemma 2.6 for — ^, we get 



e-^^-1 



+ L(VA) f ^-^^\\f{y,{s)y\s),d\^\u'^'{-),d')(s))\\ ds 
Jo 

- l\-^W^{y,{s))J{yi{s),u'^\s),d\ 
Jo 



>(2.9) 



^\u''\-),d'){s)))-X<^{y,{s))]As + o{t). 
From (2.7), (2.8) and (2.9), we get 



e-^'-l 



< o{t). 



This is a contradiction and proves the fact that V- is an approximate supersolution of 
(HJI1+). 

In a similar fashion, we can show that V- is an approximate viscosity solution of 
(HJI2+). Hence V- is an approximate viscosity solution of (HJH-). 
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3. Existence of value 

In this section we first prove the uniqueness of solutions of (HJI+) and (HJI— ). Next we 
prove that uniqueness result for (HJ1+) and (HJI—) holds true even if one is a viscosity 
solution and other is an approximate viscosity solution. Finally under Isaacs' type min- 
max condition we show that game has a value proving the main theorem of the paper. 
Now we state and prove two lemmas needed in the proof of uniqueness of (HJI+) and 
(HJI-). 

Lemma 3.1. Assume (A2). Let w be uniformly continuous. If 

then there exists cr > {which depends only on w) such that for ally G B(yo + ^O) f)) 

Proof. The proof closely mimics the corresponding result in the finite dimensional case 
[8]. We however prove it for the sake of completeness. Let 

y^'''\yo)=N[y'''']{yo)=y^'''{yo + ^)+im 
Then, for every B,i e K, 

w''' (yo + ^0 + ^i) + / (^1 ) - w''' (yo + ^o) = w''' (yo + <?o + ) + / (^i ) 

>-/(^o + ^i)+/(^o) + /(^i). 

Now, 

Ar[y.'''](yo + ^o) = inf w'''''*'(yo + ^o + ^i) + ;(^i). 
By (1.3), this infimum will be attained in some R ball. Hence we can write 
N[w'''''\yo + S^) = ^ inf w'''''''(yo + ^o + ^i) + /(^i). 

Now, taking infimum over |^i| < R on both sides of the earUer inequality we will 

have 

N[w''^'"{y^ + ^o)]-M>''''\yo + ^o)> ^ inf, m)+/(^i)-/(^o + ^i)] 

^ieK,\t,i\<R 

= />0. 

By using uniform continuity of v/^'''^ and N\y/^''^^\ we get a O such that for all y e 



Infinite dimensional differential games with hybrid controls 



249 



Lemma 3.2. Assume (Al) and (A2). Then the following results are true. 

(i) Any supersolutionw of satisfies w ' >M_|_' [w]for all d ,d . 

(ii) Any subsolution w o/(Hn2+) iarii^ei w^''^^ < mm{Mt''''\w],N[w'^'''^^]) for all 
d\d^ 

Proof. Let w be a supersolution of (HJI1+). If possible, let 

w''''''\xo)<Mi'''\w]{xo). 

By continuity, the above holds for all x in an open ball B around xq. As in Lemma 1 .8(d), 
p. 30 in [1], we can show that there exists yo&B and a smooth map <j) such that w^ —<j) 
has local minimum at yo. Since w is a supersolution of (HJI1+), this will lead to 

y'''\yo)>Mf''''[w]{yo), 

a contradiction. This proves (i). The proof of (ii) is similar. 

Next we present the proof of the uniqueness theorem. 

Theorem 3.3. Assume (Al) and (A2). Let v and w e BUC(E; W"^ """2) be viscosity solu- 
tions o/(HJI+) (or (HJI-)). Then v = w. 

Proof. We prove the uniqueness for (HJI+). The result for (HJI—) is similar. 

Let V and w be viscosity solutions of (HJ1+). We prove v'' < w'^ for all d^,d^. In 
a similar fashion we can prove that '''' < for all d\d^. 
For {d\d^) gD^x D^, define O''''''': E x E ^ R by 

<^'''^\x,y) = v^''^\x)-w^''^\y) - - K[{xf+(y)% 

where m G (0,1) fi (^^jj^^ is fixed, K,e G (0,1) are parameters, and (x)™ = 

(l + ||x||2)™/2. 

Note that x — > (x)"* is Lipschitz continuous with Lipschitz constant 1. 
We first fix ff > 0. Let (xe,ye) and {dl,dg) be such that 

^'^''''Hxe,ye) = supmax0'^''''\x,y)-E[d{x,Xe)+d{y,ye)] 
x,y d^,d^ 

and 

04,4(^xe,ye) > supmax<I>''''''^(x,y) -£. 
x,y d^d^ 

Here d{-, •) is the Tataru's distance defined by 

d(x,y)=inf [t+\\x-Sit)y\\] 
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(see [2] for more details). By Lemma 3.2, we have 

(3.1) 
(3.2) 
(3.3) 

If we have strict inequality in all the above three inequahties (that is, (3.1), (3.2) and 
(3.3)), then by the definition of viscosity sub and super solutions we will have 

1 ,a 



PiW^i'^Hye) +D+^2{ye) +H'Jf (^y^, - Kfh(yef-'ye^ > 0, (3.5) 



where 



^i{x) = ^-^-^ + K{x)^+ed{x,xe), 

-My) = ^■^^^ + '^(yr+ed{y,ye). 

In this case we can proceed by the usual comparison principle method as in [2]. 

Therefore it is enough to show that for a proper auxiliary function strict inequality 
occurs in (3.1), (3.2) and (3.3) at the maximizer. We achieve this in the following three 
steps. 

Step 1. There are two cases to consider; either there is no sequence e„ J, such that strict 
inequality holds in (3.1) or there is some sequence for which strict inequahty holds in 
(3.2). 

If there is no sequence e„ J, such that 

(>'£„) < N[w<''''n]{yeJ for all n, (3.6) 

then we have equality in (3. 1) for all e in some interval (0, Eq). By the definition of and 
the assumptions (A2), for each e G (0,£b), there exists such that 

Mo := sup ll^ell < oo 
0<e<eo 



and 



'Hye)=N[w'''^''']{ye)=w'''^'''Hye + ^e) + li^e)- 



Then, 



^"'^'"Hxe + ^e,ye + ^e) = v'^'^'^Hxe + ^e) -M>''^''Hye + ^e) - ^^^^ 
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-K[{xef + (yef]-2K\^e\ 

= ^'''^-''Hxe,ye)-2K\^e\ 

>0'^'^'''^Xe,ye)-2KMo. 
Hence we have 

^'''^'''Hxe,ye)-<^'''^^''Hxe + ^e,ye + ^e) < 2kMo. (3.7) 

We will be using this difference to define the new auxiliary function. Observe that 

Ixfl, IjeI, |<^£| are bounded. 
We define the new auxiliary function ^ by 

W'''^''\x,y)=0''''''\x,y)-e[d{x,xe)+d{y,ye)] 

where a = a{w) is the constant coming from Lemma 3.1 and tj : M'' x R'' — > M is a smooth 
function with the following properties: 

1. supp(T7)cB((0,0), 1), 

2. 0<?7 < 1, 

3. Tj(0,0) = 1 and Tj < 1 if {x,y) ^ (0,0), 

4. |Dtj| < 1. 

Now by the definition of 'P, 

- e[d{Xe + ^e,Xe) +d(ye + ^e,ye)] 
+ 2{2K+e)Mo 

>ci,dl4l^Xe,ye)+2KMo 

and 

^^4,4(^X^y)=^4,4(^^^y) if + |y-y,|2 > a\ 

Hence ^"'c■''e attains its maximum in the a ball around (xg + ^£,yg + ^e) at (say) the 
point (ig, jg). By Lemma (3.1), we now know that, for all e £ (0,eo), 

If there is a sequence e„ i such that (3.6) holds for all n, then, along this sequence, 
we proceed to Step 2 with ^'^^^'^^ = (^^4^ and (xe„,>'e„) = {xen^ye„)- 
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Thus we always have a sequence e„ J, along which we have 

w'^^" (>\.)<A^[h'<'''«](^„), (3.8) 

with (xe„,3'e„) being a maximizer of Since D' x is a finite set, without any 

loss of generality, we may assume that {dl^,dlj — (c/q,c/q) for all n. In the next step we 
check what happens to the inequaUty (3.2) at the maximizer of the new auxiUary function 

Step 2. Now for each fixed n, we proceed as follows. There are two cases either 
If 

then by the definition of m1° , there exists d^^ G such that 

w'o'^Hye„) = w'oA {ye„)+c\dldl). (3.9) 
We know that 

v<''kxeJ</<-<ixe„)+cHdldl^). 

Hence, 

-w'oAiy,^)-cHdldl) 

<o. 

Hence we get 

'i''°''hx,„JeJ<^''°<ixe„,yeJ. 

Now if strict inequality holds in w''°'^"i (ye„) < M."' [H'](>'e„)> then we are done; else 
we repeat the above argument and get d^^ S such that 

Now 

^''^''kye.) = ^'^<{ye.)-c\dl,dl) 

>w''oA{y,J-cl 

>yo4{y^J-2cl. 

Proceeding in similar fashion, after finitely many steps, boundedness of w will be con- 
tradicted and hence for some d^ = d^. e D^, we must have 

w<'''"(yeJ<A^V"M{ye„) (3.10) 
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and 

On the other hand, if 

then we proceed by taking d^=dQ. 

Step 3. For each fixed n, we proceed as follows: If 

then we proceed as in Step 2 and obtain dj^ = d|^. G such that 
X^"''Hxe„)>Mf''''[v]{Xe^) 



and 



If 



then we proceed by taking c/^ = <io • 

Thus, for every n, {xe„,ye„) is a maximizer of and 

w^"'''kye„)<N[w^"'''^{ye„), 

w''»^^"(>\)<m1"'''"M(>\), 

v'^-'^"(xe„)>Mf''"[v](xeJ. 
Also by using (3.11) and (3.12), we have that 

'V<''hxe„,ye„) <W<'''^Xe„,yeJ. 
Now we define test functions (j)i„ and (fe„ as follows: 



-2(2K + e„)MoTj (^ ^-^^^-^^./'^n-y^-^^- ^ 



+ 2{2K+£n)Mori 



Xe„ — Xe„ — i^e„ y — yen - ^£n 
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Observe that 



2(2k- + £„)Mo j.^(xe, -Xe„ - |e„ %„ -ye„ - 



t-n 



2{2k + £„)Mo fx,,, -x,„ - -yi-,, - hEn 



Note that _ attains its maximum at Xe„ and w^"'^" — 02n attains its minimum 
at ye„. Hence, as e„ — > 0, we have 



, A, 



dl.di 



<L\Xen-yen\ 1 



+ 



~ yen 



+ 0(1) 



Note that we have used \y\ < (1 + bl^)'^^ = (y) to get the above inequality. Now as 
OT — 1 < 0, it follows that 



v''-''«(xej - w^"A(jeJ < f\Xe^ -ye„\ + +0(1) 



L \xe„-yej 



< 



^ 2\\f\\^Km ^ 4||/||^>cMo 

2\\f\\^Km , 4\\f\\^KMo 



+ o(l); ase„ iO. 



For any X e and {d\d^) GD^ xD 



yd 4 _ 4 _ 2K{xf = '"^ {x,x) 

< ^4'4{x,^^y,„) + e„[dix,x,„)+d{x,yej] 

<y¥<'4{xe„,y^)+o{iy,aseni0. 

Since W'o A attains its maximum at (xe„ , j?e„ ) in the a ball around {xe^ + ^e„ , je„ + ^e„ ) . 
for an appropriate constant C, we have 

<1''"^^"(i£„,yeJ using (3.16) 
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< v''« {xe„ ) - w'''- ''''' {%„ ) + Cjc + o ( 1 ) ; as e„ i 
<M^ + ^^+C.+.(l);aseaO. 

A (7A 

Hence we get 

<aa^ + a^ + C. + „(l);ass,iO. 

Now let e„ i and then fc J, 0, to obtain 

v'^'''''(x)-w^'''''(x) <0. 

This completes the proof of uniqueness for (HJI+). 

The above uniqueness result holds true if one is the viscosity solution and the other is 
an approximate viscosity solution. This is the content of the next theorem. 

Theorem 3.4. Assume (Al) and (A2). Let vandw€ BUC(E;M'"i^'"2). Let v be a vis- 
cosity solution of (HJI+) (resp. (HJI— )) and w be an approximate viscosity solution of 
(HJI+) (resp. (HJI-)). Then v = w. 

Proof. The proof is similar to that of the previous theorem. The only change here is in 
(3.5). Since w is an approximate viscosity solution, one gets 

?iw''l'''Hye) +D+<^2{ye) +Hf''' (ye, - Km(yef-be^ 

> -eCr, 

where R = supg^g Ibe II • Note that, for fixed K,R<<x> and hence 

eCR = o{\) ase^O. 

Once we have this inequality (instead of (3.5)), we mimic all other arguments in the 
proof of the previous theorem. 

Now we can prove our main result stated in §1, namely Theorem 1.5. 

Proof of Theorem 1.5. Under the Isaacs min-max condition, (HJI—) and (HJI+) coin- 
cide. Let us denote this equation by (HJI). As in [2], by Perron's method, we can prove an 
existence of a viscosity solution for (HJI) in BUC(E,R™i^'"2), the class of bounded uni- 
formly continuous functions. Let W be any such viscosity solution. Now, by Theorem 2.7 
we know that lower and upper value functions, V- and V+ are approximate viscosity solu- 
tions of (HJI). Therefore, by Theorem 3.4, y_ = W = V+. This proves the main result. 
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4. Conclusions 

We have studied two-person zero-sum differential games with hybrid controls in infi- 
nite dimension. The minimizing player uses continuous, switching, and impulse controls 
whereas the maximizing player uses continuous and switching controls. The dynamic pro- 
gramming principle for lower and upper value functions is proved and using this we have 
established the existence and uniqueness of the value under Isaacs min-max condition. 

For finite dimensional problems, similar result has been obtained by Yong [8] under 
two additional assumptions: 

(Yl) Cheaper switching cost condition 

min c^(d^,cP-) =: Cn < /n = inf H^)- 
d^yid^ lei: 

(Y2) Nonzero loop switching cost condition 

For any loop {{dl,df)}j^^ CD^ x D^, with the property that 

j < OT1OT2, dj_^.l = d\ , J^+i = di; 
either dj^i = dj, or df^^ =df VI < «' < j. 

It holds that 

tc\dl,dl^,)-tc^{df,dl,)^0. 

Thus our result not only extends the work of [8] to infinite dimensions but also proves 
the uniqueness of the viscosity solutions of upper and lower SQVI without the above two 
conditions (Yl) and (Y2). Also we have shown that under Isaacs' min-max condition, the 
game has a value. Moreover, we have given explicit formulation of dynamic programming 
principle for hybrid differential games and have also proved it which is not done in [8]. 
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